http://wje.sciedupress.com 


World Journal of Education 


Vol. 7, No. 4; 2017 


A Combination of Teacher-Led Assessment and Self-Assessment Drives 
the Learning Process in Online Master Degree in Transplantation 


Ahmed Halawa 1&2 *, Ajay Sharma 2&3 , Julie M Bridson 2 , Sarah Lyon 2 , Denise Prescott 2 , Arpan Guha 2&3 and David 

Taylor 3 

Sheffield Teaching Hospitals, Sheffield, UK 

2 Faculty of Health and Life Science, Institute of Learning and Teaching, University of Liverpool, UK 
3 Royal Liverpool University Hospitals, Liverpool, UK 

*Correspondence: Consultant Transplant Surgeon, Sheffield Teaching Hospitals, Herries Road - Sheffield S5 7AU, 
United Kingdom. Tel: 44-778-754-2128. E-mail: ahmed.halawa@sth.nhs.uk 

Received: June 30, 2017 Accepted: August 11, 2017 Online Published: August 20, 2017 

doi:10.5430/wje.v7n4p85 URL: https://doi.org/10.5430/wje.v7n4p85 


Abstract 

Background: Good performance in a summative assessment does not always equate to educational gain following a 
course. An educational programme may focus on improving student’s performance on a particular test instrument. 
For example, practicing multiple choice questions may lead to mastery of the instrument itself rather than testing the 
knowledge and its application. We designed an assessment strategy that consistently valid and reliable that would fit 
with the students with a range of 27 nationalities with a different institutional, cultural and educational background in 
this totally online masters programme in transplantation. 

Methods: Based on the published evidence, we analyzed 2 main assessment domains: (a) self-assessment and (b) 
peer-assessment. We compared them with traditional teacher-led assessment considering the diversity of students. 

Conclusion: We conclude that traditional teacher-led assessment supplemented by self-assessment is a strong drive 
in the learning process in this on-line course, whilst peer-assessment is challenging and associated with many flaws 
giving the diversity of our students. Peer-assessment may be unreliable and not valid due to the difference in the 
institutional background and variation in experience between the students. 

Keywords: self-assessment; peer-assessment; teacher-led assessment; distance learning; transplantation; and 
clinical education 

1. Introduction 

During undergraduate education, most of us dreamt of an education system that would be without the stress of exams 
wherein a regular assessment of our performance in the classroom would be deemed good enough to let us progress 
to the next year. That ‘imaginary’ education made us feel ‘she smiles at me and I am seventeen again’, though far 
from reality. In contrast, the reality has been that we had to undergo a battery of (read it battering by) summative 
tests after tests and, therefore, the educational process transformed to be an assessment-orientated exercise. While the 
summative assessment used to give us anxiety (to say least), but in retrospect we appreciate that the anxiety was one 
of main drivers for our learning. As a result of that self-imposed drive and the pressure of expectations by family and 
society, we worked hard to pass the exams but focused (deep learning) mainly on the areas of the curriculum that 
were going to be the focus of assessment. On the other hand, those areas of curriculum that were not included in the 
assessment were studied lightly (surface learning). It is not only the quantity but also the quality of learning, which is 
strongly influenced by the mode of assessment. In other words, an assessment process promotes deep learning and, 
thereby, helps retention of facts and understanding of concepts. However, the understanding of concepts is dependent 
on how well the assessment is designed and structured. Poorly designed assessment encourages surface learning with 
short-lived educational outcomes. In fact a quality education is the product of continuous interaction between 
instruction, curriculum and assessment as suggested by Hamblton and Pitoniak (2006) (fig 1). 
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Figurel. The Curriculum-Instruction-Assessment (CIA) Model of Course Development 

In our previous article (Halawa et al, 2017) in a previous issue of this journal, we illustrated our experience of 
designing and conducting a totally online course in clinical transplantation. This course is designed to deliver 
up-to-date knowledge and state-of-art clinical experience in transplantation reflecting the clinical practice of many 
UK as well as well-known international centres. Successful completion would lead to award a degree 
(Diploma/Master) from the University of Liverpool, a Russell group of universities that ensures credibility and 
quality assurance of the education. Due to the reflective nature of this education we have to structure the 
assessment to define threshold concepts that the students should be able to understand (Sharma et al, 2017). 

Structured assessment is also the most appropriate engine to fine-tune and reform the curriculum. The assessment 
guides us as tutors to stress on the parts of the curriculum not digested well by our students. It is expected that the 
teachers do not to waste time and effort in teaching unimportant and irrelevant topics overloading the students. 
Designing a curriculum without implementing a structured assessment strategy is meaningless and waste of time. In 
other words, taking a test does not end learning, but just signals the beginning. 

When we blueprinted the online master degree in transplantation, we have to think how would we design the 
assessment. Self-assessment where the student takes the lead of his assessment, peer-assessment where students 
assess each other based on clearly defined rubrics or implement the standard teacher-led assessment. Do we need to 
implement different assessment modalities or stick to only one? 

2. Self-assessment 

Implementing self-assessment strategy helps the students to reflect on their own work with the aim to promote their 
learning process, thereby, achieving the planned learning objectives of this course. It lends itself very well to the 
formative assessment strategy adopted in this course. In this context, it is not synonymous with self-grading (Weimer, 
2010). The course faculty strongly believes that self-assessment is a formative exercise that promotes critical 
analysis and qualitative evaluation of learning rather than a summative and quantitative function looking at scores 
and grades to pass the test. This assessment strategy helps the student to identify the gap between the planned and the 
achieved outcome. McMillan and Hearn, (2008) defined self-assessment accurately as “ a process by which students 
monitor and evaluate the quality of their thinking and behaviour when learning and identify strategies that improve 
their understanding and skills ” (p.40). In this respect, self-assessment aligns closely with standard (criterion)-based 
assessment rather than the standardized assessment, where student’s performance is assessed against his previous 
performance, a predefined standard or a set score rather than against the performance of peers (Brown, 1988; Anon, 
2006). 

In transplantation education, self-assessment is an excellent means for testing factual knowledge including 
understanding of formulae and terminology; also it tests the metacognitive skills; a reflective process fostering deep 
understanding, critical thinking and reasoning. This strategy lends itself very well to this distance-learning course, 
where the administration and marking of objective multiple choice questions (MCQ) for self-assessment are easily 
automated through the university e-blackboard. 
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Figure 2. Self-assessment Cycle 


McMillan and Hearn (2008) conceptualized self-assessment as a cycle of three components closely related to each 
other: self-monitoring, self-evaluation, and identification and implementation of required remedies and corrections 
(Figure 2). Essentially, the students in this course are encouraged to evaluate their learning and performance 
outcomes, construct their own feedback based on well-defined standards. Then they determine the next steps to 
improve their performance. This cycle should be repeated to promote the learning process. Mabe and West’s (1982) 
and also Gordon (1991) highlighted the importance of student’s experience as an important factor for a successful 
self-assessment process. Effectiveness of formative assessment is promoted by precise, explicit and timely feedback 
by the faculty who are well trained in the engaging the students. 

We can conclude from the above discussion that self-assessment in this course is an essential driver for effective 
formative assessment. In fact, Sadler (1989) and Black and William (1998) suggested that self-assessment is the 
foundation for an effective feedback process. It was not an exaggeration when Black and William suggested that the 
self-assessment is “a sine qua non for effective learning’’ (p. 26). 

There are two basic strategies for self-assessment (Scott, 2000) that are implemented in this distance learning course: 
Firstly, self-assessment of task performance using models and/or scoring rubrics. In this respect, the questions are 
focused on factual knowledge, definitions and undisputed observations. The provided MCQ tests are suitable for this 
purpose. The availability of online marking schemes makes this possible. Limited response questions provided in the 
discussion board are also a useful tool as they mainly deal with factual knowledge. We think that, constructed 
response questions are the most challenging format to assess task performance, as they may be open-ended with 
multiple solutions, which may affect the validity of the self-assessment. Secondly, the self-assessment is a 
continuous process as the students in this course react to responses by other students as the reply to the questions 
posed in relation to management of clinical scenario (n=120 spread over 3 modules) on e-blackboard. This 
metacognitive self-assessment through reflection is a type of self-assessment that focuses mainly on deep 
understanding, critical thinking and clinical reasoning. The different formative assessment strategies in this course 
(poster presentation, mini-review and case scenarios) are designed in a way to test the metacognitive function. We 
strongly believe that, the most reliable approach is to pose constructed response questions, as we mentioned before, 
the student participate in discussions and express their assumptions in response to open-ended questions that have 
multiple solutions. Moreover, portfolio assessment as a future evolution of the course would serve the same purpose. 


3. Shortcomings of Self-Assessment in the Online Distance Education in Transplantation 

Employing the self-assessment strategy does have some inherent flaws, which have been addressed in this course. 
From experience, not all students are familiar with the process of self-assessment and, therefore, they might be 
outside their comfort zone. They may believe that this assessment is the duty of the course tutors (Falchikov, 2003) 
and become reluctant to take this elective form of assessment (Liang, 2014). Students tend to overestimate their 
knowledge (Shrauger and Osberg, 1981) and underestimate the immense power of reflective exercise. They may not 
be able to recognize their own deficiencies especially in the written work. Providing the students with checklist is 
helpful guidance when they mark their own work. As the students may not take it seriously, the self-assessment may 


Published by Sciedu Press 


87 


ISSN 1925-0746 E-ISSN1925-0754 









http://wje.sciedupress.com 


World Journal of Education 


Vol. 7, No. 4; 2017 


lose its reliability (Dickinson, 1987). There may be potential for a breach of confidentiality and sense of humiliation 
on reporting the student own weakness in the virtual class (Dickinson, 1987). Our role as tutors is to provide the 
necessary education and training in the self-assessment process to bridge these barriers and helps to achieve the 
learning objectives planned from self-assessment. 

4. Peer-assessment 

In peer-assessment, the students assess the coursework of each other. Peer assessment is an innovation in assessment 
aiming at empowering the students and improving the quality of education through promotion of reflection (Mowl, 
1996; McDowell and Mowl, 1996). Peer-assessment extends beyond marking the coursework to involve setting of the 
acceptable evidence of achievement and pass marks (Biggs, 1999; Brown et al, 1994). 

We see peer-assessment as a powerful tool for motivation that gives the students a sense of ownership of the 
assessment process. Giving the online nature of this course that deals with ambiguous and complex topic like 
transplantation, we are reluctant to employ this formative assessment strategy for two main reasons. Firstly, we are 
concerned about the reliability and validity of this form of assessment due to the difference in the institutional 
background and variation in experience between the students. In addition, we are not sure about the quality and 
consistency of the feedback given by the students. We rely on high quality feedback to achieve our educational goals. 
Heywood (2000) and Stefani (1994) and other investigators demonstrated those students tend to under-mark the 
coursework compared to tutors. Others found the opposite, where there is a tendency to over-mark (Boud and Holmes, 
1995), a dilemma we are keen to avoid in this course. Secondly, underperforming students are unable to assess the 
coursework of their well-performing peers giving the complex nature of transplantation science. Their judgement may 
be unrealistic and unfair, and the given feedback may be irrelevant. 

5. Teacher-Led Assessment (TLA) 

The term ‘teacher-led assessment’ (TLA) is used throughout this document to refer to any assessment activity that is 
carried out by a teacher in supporting candidates’ learning and assessing his/her knowledge based on a well-defined 
standard/rubrics. The key role played by the tutors involved in the assessment in the course is to identify and deal with 
the following: 

A. Lack of engagement 

Coursework in renal transplantation distance education requires the student to be actively engaged throughout the 
learning process to achieve the planned learning objectives (Astin, 1993; Pascarella and Terenzini, 1991). 
Disengagement could be an issue especially when collaborative coursework is required particularly for a group of 
students with different personal and institutional background. Disengagement is not uncommon. Kuh and colleagues 
(2000) reported 18% of these students in 128 institutes were not academically engaged. In transplantation science 
education, like in any other disciplines, disengagement occurs at different levels, emotional, intellectual and physical 
(Concordia University, 2014). Getting the student emotionally involved in coursework assessment by providing a 
strong link to his/her clinical and day-to-day practise in transplantation helps to achieve the learning objectives. Loss 
of interest during the collaborative work and poor attention can be counteracted by keeping the students intellectually 
active through the involvement of each member of the group by defining roles for each member of the team. Physical 
disengagement entails reluctance of some member of the group to seek the planned task including the appropriate use 
of the available resources such as a library and the provided websites. 

As course tutors, we should be able to predict which student will drift away and become disengagement, also which 
course structure that encourages the disengagement. These tasks would be difficult to achieve if the assessment is 
purely self or peer assessment. The online nature of the course allows the students to live on their virtual plants 
separated by time and space encouraging more disengagement. Hu and Kuh, (2000) demonstrated that certain student 
background characteristics such as race, ethnicity and gender have an influence on the level of engagement. In their 
interesting study, they showed that white American and Asian have tendency towards disengagement. This factor is 
important in our online education in transplantation giving its international nature. They also found that men were 
more likely to be either not engaged at all or highly engaged compared with women. We suspect that the past 
experience, background knowledge and student preparation have an effect on the level of engagement. Experienced 
clinicians joining the course and students who have a higher degree in a closely related subject such as urology or 
nephrology will find it easy to engage in the transplant education particularly in collaborative coursework. There is 
strong evidence that the level of engagement differs based on their institutional background (Boyer, 1989; Kuh and 
Hu, 2001a). Students coming from research institutes are less likely to engage. This is very relevant to this course 
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where the course is more clinically oriented. Researchers may find this clinical atmosphere where case-based 
discussion and clinical scenarios are the main assessment tools. We suspect that students coming from a reputable 
institute more likely to have a higher level of engagement in collaborative coursework. Course structure also may 
promote disengagement by having too many periodic assessment deadlines. This has been avoided in this course, 
where the core education for each module is delivered over 26 weeks. The students can submit his coursework 
during the next 52 weeks resisting the temptation of delaying learning by having unnecessary many deadlines. 

Students who are not engaged throughout the learning process are noted and contacted individually to resolve any 
issues they might be facing. It is essential to identify these problems and resolve them as soon as they arise to 
facilitate engagement from the beginning before it is too late (when it comes to the assessment stage). Students, who 
are distracted by the media of delivery, cannot engage properly. 

E-mail addresses for general enquiries and also the contact e-mail of the lead tutor of each module is provided in the 
original blueprinting of the course (in the course handbook) to help any student having difficulty with the course. 

B. Alignment with the national guidelines 

We gave it a special consideration in the original design of the course. Personally we find it also challenging 
especially when we deal with overseas students and students with different ethnic background. In the context of 
organ transplantation, patients from Afro-Caribbean origin are known to have a high incidence of diabetes and also 
are at higher risk of immunological rejection of the transplanted organs. They require special consideration when we 
plan for organ transplantation. Deceased donor transplantation is not popular in certain countries due to lack of 
resources and also generates an ethical dilemma in other countries (Japan and the Middle East). There is a high 
incidence of certain diseases in some parts of the world (HIV in central and southern parts of Africa), which need 
special attention when we design the immunosuppression protocol. Due to the financial constraints, cheap and less 
effective immunosuppressive drugs are used in other parts of the world. 

It is quite challenging to accommodate these different national guidelines in the curriculum and subsequently in the 
assessment in case of self and peer assessment. On the other hand, tutors should meet their educational needs 
suggested Khaleghitabar and colleagues in 2016 in order absorb this diversity in practice. The assessment in 
transplantation is structured to match the learning objectives in a way not to breach the international guidelines 
especially for overseas doctors. Also, it is always possible to base the assessment performed by experienced tutor 
on common ground and mutually agreed knowledge (Clark and Brennen, 1991) rather than diving into a deep sea of 
disputes and uncertainties. 

C. Managing underperforming students 

Initially, we thought that students fail the assessment due to lack of knowledge and professionalism, but Duffy 
(2004a) and also Cohen and Rhydderch (2006) highlighted other good reasons for failure. Behavioural issues such as 
poor communication, lack of interest, failure to engage during the learning process can lead to an unsuccessful 
outcome especially when collaborative work is assessed (analysis of guidelines and WebQuest). Lack of personal 
insight into the professional boundaries is an additional cause of concern. These soft skills are essential to be 
assessed to ensure long-lasting outcome. In fact, they constitute an integral part of the hidden curriculum of this 
course. 

We designed the coursework strategy to test the depth as well as the breadth of knowledge by employing different 
coursework formats. Equally important, failure to demonstrate sound and professional implementation of this 
knowledge in line of the national guidelines is considered underperformance. We are always looking at how the 
student implements rather regurgitate of the knowledge (outcome-based assessment) (Norcini, 2003). Satisfactory 
outcome in a given treatment plan does not only indicate mortality and morbidity but also highlights other important 
endpoints such as feasibility of the suggested treatment plan, patient satisfaction, functional status and cost 
effectiveness. In teacher-led assessment, we are keen for the students to demonstrate multidimensional approach 
when they design their management plan by looking at the other endpoints mentioned before. For the public, this 
multidimensional approach provides reassurance that the doctor is performing well in clinical practice. For individual 
patients, it helps to choose which doctor to trust. For doctors, it provides reassurance that the assessment reflects 
their real day-to-day practice. 

D. Implement strategies to address underperformance 

In this course, as in many other aspects of life, “prevention is better than cure” is the way forward to avoid such 
unfavourable outcome. We describe the undergraduate education as a “piece-meal” education, where the tasks are 
clear and the boundaries are well defined, but the postgraduate arena is different. It requires more understanding and 
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maturity from both the students and the tutors about the amount of work required due to the vagueness and lack of 
clear boundaries in postgraduate education in general and in transplantation science in particular. Underestimating 
the amount of work required in transplantation science is a major issue that may lead to underperformance. This 
requires clear explanation to the learners from the outset and to “think outside the box”. Also, careful monitoring 
from module leads is paramount. 

We strongly believe that the first sign of underperformance is a lack of engagement. It is quite easy to drift down the 
disengagement route due to the “virtual classroom” nature of the course, which should be picked up through careful 
monitoring, and dealt with promptly by identifying barriers to their engagement. Also it is our duty to provide 
counseling to renew their enthusiasm and to “top up” their motivation by prompt and constructive criticism. The 
tutor must be aware of the ethnic and socioeconomic background and also the student’s personality trait, which we 
believe have a strong impact on how we should deliver the feedback. Negative feedback is demotivating and not 
welcomed. 

Finally, it is important to address the value of tutor leadership as a driving force for success of this course. Excellent 
communication between the tutors themselves and between tutors and students, paying attention to the teaching 
quality improve the leadership and subsequently lead to the success of the course. Tutors acting as discussion leaders, 
who summarize, explain, debate, and use diagrams to illustrate concepts rather than facilitating particularly for 
underperforming students improve the learning outcome and improve their performance as pointed by Shield et al 
(2007). 

6. Conclusion 

There is more to assessment than seeing if the requirements for achieving a qualification have been met. Teachers 
make professional judgments on learners’ performance in every teaching and learning session undertaken, whether 
consciously or subconsciously. Using these professional judgments and translating them into feedback on the quality 
of individuals’ work is the focus of ‘assessment for learning’, which is the main objective of our assessment strategy. 
Self-assessment is also needed to promote teacher-led assessment. The diversity of our students and the international 
nature of this course is a hurdle in implementing peer-assessment. We conclude that the traditional teacher-led 
assessment supplemented by self-assessment though with inherent flaws, has been a strong drive in learning process 
in this on-line course. 
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